Defect correction based on “virtual” lenslets

ABSTRACT

A system constructs an image using virtual lenslets.

TECHNICAL FIELD

The present application relates, in general, to imaging.

SUMMARY

In one aspect, a method includes but is not limited to: capturing aprimary image representation with a photo-detector array at a primaryposition; associating a primary set of discrete portions of the primaryimage representation with one or more defined virtual lenslets of alens; moving the photo-detector array to another position; capturinganother image representation with the photo-detector array at the otherposition; associating another set of discrete portions of the otherimage representation with the one or more defined virtual lenslets ofthe lens; and assembling an image from those virtual lenslet associatedportions of the primary and the other image representation that haverelatively sharper focuses. In addition to the foregoing, other methodaspects are described in the claims, drawings, and text forming a partof the present application.

In one or more various aspects, related systems include but are notlimited to circuitry and/or programming for effecting theherein-referenced method aspects; the circuitry and/or programming canbe virtually any combination of hardware, software, and/or firmwareconfigured to effect the herein-referenced method aspects depending uponthe design choices of the system designer.

In one aspect, a system includes but is not limited to: a lensassociated with one or more virtual lenslets; a controller configured toposition a photo-detector array at a primary and another position; animage capture unit configured to capture a primary image at the primaryposition and another image at the other position; and an imageconstruction unit configured to utilize at least a part of the one ormore virtual lenslets in association with at least one of the primaryimage and the other image. In addition to the foregoing, other systemaspects are described in the claims, drawings, and text forming a partof the present application.

In addition to the foregoing, various other method and/or system aspectsare set forth and described in the text (e.g., claims and/or detaileddescription) and/or drawings of the present application.

The foregoing is a summary and thus contains, by necessity,simplifications, generalizations and omissions of detail; consequently,those skilled in the art will appreciate that the summary isillustrative only and is NOT intended to be in any way limiting. Otheraspects, inventive features, and advantages of the devices and/orprocesses described herein, as defined by the claims, will becomeapparent in the detailed description set forth herein.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 shows a front-plan view of image 100 of a person (e.g., person202 of FIG. 2) projected onto photo-detector array 102.

FIG. 2 depicts a side-plan view of lens system 200 that can give rise toimage 100 of FIG. 1.

FIG. 3 illustrates a perspective view of lens 204 positioned to focuslight onto an imaging surface of photo-detector array 102.

FIG. 4 shows the perspective view of FIG. 3 wherein exemplary “virtuallenslets” are illustrated.

FIG. 5 depicts the perspective view of FIG. 4 wherein projections of theexemplary virtual lenslets onto the imaging surface of photo-detectorarray 102 are illustrated.

FIG. 6 depicts a high level logic flowchart of a process. Method step600 shows the start of the process.

FIGS. 7 and 8 depict partial perspective views of the system of FIG. 2wherein photo-detector array 102 is being moved in accordance withaspects of processes shown and described herein (e.g., in relation toFIG. 6).

FIG. 9 illustrates a perspective view of the system of FIG. 2 whereinphoto-detector array 102 is being moved in accordance with aspects ofprocesses shown and described herein (e.g., in relation to FIG. 6).

The use of the same symbols in different drawings typically indicatessimilar or identical items.

DETAILED DESCRIPTION

With reference to the figures, and with reference now to FIG. 1, shownis a front-plan view of image 100 of a person (e.g., person 202 of FIG.2) projected onto photo-detector array 102. Image 100 is shown asdistorted due to defects in a lens through which image 100 has beenprojected (e.g., lens 204 of lens system 200 of FIG. 2). First portion104 of image 100 is illustrated as large and blurry, which can occurwhen a lens defect causes portion 104 of image 100 to come to a focus infront of a surface of photo-detector array 102. Second, third, andfourth portions 106 are illustrated as right sized, which can occur whenthe lens causes portions 106 of image 100 to correctly focus on animaging surface of photo-detector array 102. Fifth portion 108 is shownas small and faint, which can occur when a lens defect causes portion108 of image 100 to come to a focus (virtual) behind an imaging surfaceof photo-detector array 102. In addition, although not expressly shown,those having skill in the art will appreciate that various lens defectscould also cause the image to be distorted in x-y; those having skill inthe art will also appreciate that different colored wavelengths of lightcan in and of themselves focus at different positions due to differencesin refraction of the different colored wavelengths of light. Inaddition, although not expressly shown herein, those having skill in theart will appreciate that the subject matter disclosed herein may serveto remedy misfocusings/distortions arising from defects other than lensdefects, such as, for example, defects in the imaging surface ofphoto-detector array 102 and/or defects in frames that hold one or morelenses.

Referring now to FIG. 2, depicted is a side-plan view of lens system 200that can give rise to image 100 of FIG. 1. Lens 204 of lens system 200is illustrated as located at a primary position and having defects thatgive rise to the five different portions of image 100 shown anddescribed in relation to FIG. 1. First portion 104 of image 100 isillustrated as focused in front of an imaging surface of photo-detectorarray 102. Second, third, and fourth portions 106 are illustrated asright sized and focused on an imaging surface of photo-detector array102. (It is recognized that in side plan view the head and feet ofperson 202 would appear as lines; however, for sake of clarity, they areshown in profile in FIG. 2 to help orient the reader relative to FIG.1.) Fifth portion 108 is shown as small and faint, and virtually focusedbehind an imaging surface of photo-detector array 102. In addition,although not expressly shown herein, those having skill in the art willappreciate that the subject matter of FIG. 2 is also illustrative ofthose situations in which one or more individual photo-detectors formingpart of the imaging surface of photo-detector array 102—rather than oneor more lenses of lens system 200—deviate from one or more predefinedpositions by amounts such that image misfocuses/distortions arising fromsuch deviations are unacceptable. That is, insofar as image misfocusingand/or distortion could just as easily arise from photo-detector array102 having mispositioned photo-detectors as from lens system 200 havingmispositioned/defective lenses, the subject matter disclosed herein mayserve to remedy misfocusings/distortions arising from defects in theimaging surface of photo-detector array 102.

Continuing to refer to FIG. 2, further shown are components that canserve as an environment for one or more processes shown and describedherein. Specifically, controller 208 is depicted as controlling theposition of photo-detector array 102 (e.g., via use of a feedbackcontrol subsystem). Image capture unit 206 is illustrated as receivingimage data from photo-detector array 102 and receiving control signalsfrom controller 208. Image capture unit 206 is shown as transmittingcaptured image information to focus detection unit 210. Focus detectionunit 210 is depicted as transmitting focus data to image constructionunit 212. Image construction unit 212 is illustrated as transmitting acomposite image to image store/display unit 214.

With reference now to FIG. 3, illustrated is a perspective view of lens204 positioned to focus light onto an imaging surface of photo-detectorarray 102. The focused light is illustrated as projecting a geometricpattern 300 onto the imaging surface of photo-detector array 102 that ismore or less the same shape as lens 204. Image 100 (e.g., FIGS. 1 and 2)is shown being projected within the confines of geometric pattern 300.As noted, lens 204 gives rise to portions 104, 106, and 108 of image100. The inventors have discovered that the misfocused/distortedportions 104 and 108 can be corrected by using a virtual lens technique.

Referring now to FIG. 4, shown is the perspective view of FIG. 3 whereinexemplary “virtual lenslets” are illustrated. Lens 204 is depicted ashaving inscribed within it several small circles that may be conceivedof as “virtual lenslets” 400. The term “virtual” is used herein toindicate that in most instances these virtual lenslets are conceptualoverlays (e.g., mathematical constructs) onto at least a portion of theactual physical lens 204. In various implementations, the overlays aredone mathematically and/or computationally.

With reference now to FIG. 5, depicted is the perspective view of FIG. 4wherein projections of the exemplary virtual lenslets onto the imagingsurface of photo-detector array 102 are illustrated. Virtual lenslets400 are shown as geometrically projected within the confines ofgeometric pattern 300 on the imaging surface of photo-detector array102. In various implementations, the projections are done mathematicallyand/or computationally.

As noted elsewhere herein, lens defects and/or other factors may giverise to z-axis misfocusing and/or x-y plane distortion in all or part ofimage 100. In one implementation, all or part of such z-axis misfocusingand/or x-y plane distortion is corrected by using one or more virtuallenses in conjunction with tilting and/or rotation of photo-detectorarray 102.

Referring now to FIG. 6, depicted is a high level logic flowchart of aprocess. Method step 600 shows the start of the process. Method step 601depicts associating/generating virtual lenslets that overlay a lens at aknown position. For example, for any particular lens, a pre-stored setof virtual lenses for such a particular lens might be recalled or mightbe calculated in near real-time. In some instances, the calculation iskeyed to image requirements (e.g., higher resolution requirements wouldtypically engender more virtual lenslets and lower resolutionrequirements would typically engender fewer virtual lenslets).

Referring again to FIG. 2, one specific example of method step 601 (FIG.6) would be image capture unit 206 recalling a set of mathematicalfunctions defining virtual lenslets (e.g., virtual lenslets 400 of FIG.4) from memory storage and thereafter fitting the recalled virtuallenslet mathematical functions onto/into a likewise recalled knownmathematical geometry of lens 204 of FIGS. 2, 3, and 4. Another specificexample of method step 601 (FIG. 6) would be image capture unit 206calculating set of mathematical functions defining virtual lenslets(e.g., virtual lenslets 400 of FIG. 4) in response to user resolutionrequirements, and thereafter fitting the calculated virtual lensletmathematical functions onto/into an either a measured, a calculated, ora recalled known mathematical geometry of lens 204 of FIGS. 2, 3, and 4.

Method step 602 illustrates projecting the virtual lenslets onto animaging surface of a photo-detector at a known primary position (e.g., amathematical projection).

Referring again to FIG. 2, one specific example of method step 602 (FIG.6) would be image capture unit 206 obtaining from lens system 200'scontrol system (not shown) positioning information of lens 204 andthereafter using that position information, in conjunction with themapped virtual lenslets (e.g., method step 601), to mathematicallyproject the virtual lenslets onto a known imaging surface primaryposition of photo-detector array 102. In one specific example, imagecapture unit 206 obtains the imaging surface primary position fromcontroller 208.

Method step 603 depicts capturing a primary image with a photo-detectorarray at a primary position. In one implementation, method step 603includes the sub-step of capturing the primary image at an averageprimary focal surface location of a lens. In another implementation,method step 603 includes the sub-step of capturing the primary imagewith a photo-detector array at the average primary focal surfacelocation of a lens (e.g., positioning the lens such that a defined focalsurface of the lens coincides with an imaging surface of aphoto-detector array).

Referring again to FIG. 2, one specific example of method step 603 (FIG.6) would be controller 208 positioning photo-detector array 102 at aprimary position, and thereafter instructing image capture unit 206 tocapture an image from photo-detector array 102.

Method step 603A depicts associating portions of the captured primaryimage with the projections of the virtual lenslets. In oneimplementation, method step 603A includes the sub-step of associatingportions of the captured primary image with mathematical projections ofthe virtual lenslets.

Referring again to FIGS. 2, 4, and 5, one specific example of methodstep 603A (FIG. 6) would be image capture unit 206 mapping themathematical projections of the virtual lenslets 400 (FIGS. 4 and 5)into the primary image captured from photo-detector array 102.

With reference again to FIG. 6, method step 604 illustrates determiningfocused and/or out-of-focus portions of the primary image that map withthe projected virtual lenslets. In one implementation, method step 604includes the sub-step of calculating a Fourier transform of at least apart of the primary image that maps to a virtual lenslet (e.g., sharp,or in-focus images produce abrupt transitions that often havesignificant high frequency components).

Referring again to FIG. 2, one specific example of method step 604 (FIG.6) would be focus detection unit 210 performing a Fourier transform andsubsequent analysis on those virtual-lenslet mapped parts of an imagethat has been captured by image capture unit 206 when photo-detectorarray 102 was at the primary position. In this example, focus detectionunit 210 could deem portions of the image having significant highfrequency components as “in focus” images. As a more specific example,the Fourier transform and analysis may be performed on one or more partsof the image that are associated with one or more virtual lenslets 400of lens 204 (e.g., FIGS. 4 and 5).

With reference again to FIG. 6, method step 605 shows moving thephoto-detector array to another position. In one implementation, methodstep 605 further includes the sub-step of moving at least a part of thephoto-detector array to the other position while the lens is heldstationary (e.g., photo-detector array 102 is moved to another position,while lens 204 remains stationary, such as shown and described inrelation to FIGS. 4 and 5). In another implementation, the step ofmoving at least a part of the photo-detector array to the other positionfurther includes the sub-step of tilting the photo-detector array. Inanother implementation, the step of moving at least a part of thephoto-detector array to the other position further includes the sub-stepof rotating the photo-detector array. In another implementation, thestep of moving at least a part of the photo-detector array to the otherposition further includes the sub-step of tilting and rotating thephoto-detector array. In another implementation, the step of moving atleast a part of the photo-detector array to the other position furtherincludes the sub-step of distorting the photo-detector array such thatthe at least a part of the photo-detector array resides at the otherposition (e.g., a part of photo-detector array 102 is moved to anotherposition, such as might happen if photo-detector array 102 were to becompressed laterally in a controlled manner or moved usingmicro-electro-mechanical-systems (MEMS) techniques, while lens 204remains stationary, such as shown and described in relation to FIGS. 7,8, and/or 9). Those having skill in the art will appreciate that theherein described tilting and/or rotating will move the photo-detectorarray in x, y, and/or z directions such that other image surfaces oflens 204 may be captured.

Referring now to FIGS. 2, 7, 8, and/or 9, one specific example of methodstep 605 (FIG. 6) would be controller 208 positioning photo-detectorarray 102 at the other position using feedback control sub-systems (notshown). Those having skill in the art will appreciate that the hereindescribed tilting and/or rotating will move photo-detector array 102 inx, y, and/or z directions such that other image surfaces of lens 204 maybe approximately captured. As a specific example, successively tiltingphoto-detector array 102 such that successive relatively-in-focusvirtual lenslet projections of first portion 104 or fifth portion 108may be captured at or near the focused and/or undistorted first portion104 or fifth portion 108 (e.g., as shown and described in relation toFIG. 2).

With reference again to FIG. 6, method step 606 shows capturing anotherimage with the photo-detector array at the other position. In oneimplementation, method step 606 further includes the sub-step ofextracting at least one of a red, blue, and green color component of theother image. In another implementation, the step of extracting at leastone of a red, blue, and green color component of the other image furtherincludes the sub-step of numerically filtering the other image.

Referring now to FIGS. 2, 7, 8, and/or 9, one specific example of methodstep 606 (FIG. 6) would be image capture unit 206 capturing an imagefrom photo-detector array 102 at the other position. In oneimplementation, logic of image capture unit 206 communicates with logicof controller 208 to capture the other image when photo-detector array102 is as the other position. In one implementation, logic of imagecapture unit 206 extracts at least one of a red, blue, and green colorcomponent of the other image. In one implementation, logic of imagecapture unit 206 extracts the at least one of a red, blue, and greencolor component by use of numerical filtering techniques.

Method step 607 depicts associating portions of the captured other imagewith the projections of the virtual lenslets. In one implementation,method step 607 includes the sub-step of associating portions of thecaptured other image with mathematical projections of the virtuallenslets through a volume of space and onto an imaging surface of thephoto-detector array at the other position.

Referring again to FIGS. 2, 7, 8, and/or 9, one specific example ofmethod step 607 (FIG. 6) would be image capture unit 206 mapping themathematical projections of the virtual lenslets 400 (FIGS. 4 and 5)into the other image captured from photo-detector array 102. In oneimplementation of method step 607, logic of image capture unit 206 mapsthe mathematical projections of virtual lenslets 400 (FIGS. 4 and 5)into the other image captured from photo-detector array 102. In oneimplementation of method step 607, logic of image capture unit 206determines where on re-positioned photo-detector array 102 the virtuallenslets 400 will project (e.g., mathematically projecting the virtuallenslets onto a known imaging surface location of the re-positionedphoto-detector array).

With reference again to FIG. 6, method step 608 depicts determining thefocuses of the portion(s) of this other image that map with theprojected virtual lenslets (e.g., the virtual lenslets of method step601).

In one implementation, method step 608 includes the sub-step ofcalculating a Fourier transform of at least a part of at least oneregion of the other image that maps with the projected virtual lenslets(e.g., sharp or in-focus images produce abrupt transitions that oftenhave significant high frequency components). In one implementation, thestep of calculating a Fourier transform of at least one region of theother image that maps with the projected virtual lenslets includes thesub-step of determining the Fourier transform and analysis on one ormore parts of the image that are associated with one or more virtuallenslet projections intersecting the re-positioned photo-detector array.

Referring again to FIGS. 2, 7, 8, and/or 9, one specific example ofmethod step 608 (FIG. 6) would be focus detection unit 210 performing aFourier transform and subsequent analysis on at least a part of an imagecaptured by image capture unit 206 when photo-detector array 102 was atthe other position specified by controller 208. In one specific example,focus detection unit 210 receives an image and its associated virtuallenslet projections from image capture unit 206 and thereafter performsthe Fourier transforms and subsequent analyses on a per-virtual-lensletbasis, and thereafter stores the results of the transforms and analysesin memory. Those skilled in the art will appreciate that such Fouriertransforms and subsequent analyses constitute specific examples of moregeneral “image scores,” and that other suitable image analysistechniques, consistent with the teachings herein, may be substituted forthe Fourier transform and analysis.

With reference again to FIG. 6, method step 610 depicts constructing acomposite image by replacing the out-of-focus virtual lenslet portion(s)of the primary image with their more in-focus counterparts. In oneimplementation, method step 610 includes the sub-step of replacing atleast a part of one out-of-focus virtual-lenslet region of the primaryimage with at least a part of one more-in-focus virtual-lenslet regionof the other image. In yet another implementation, method step 610includes the sub-step of utilizing at least one of tiling imageprocessing techniques, morphing image processing techniques, blendingimage processing techniques, and stitching image processing techniques.

In yet another implementation, method step 610 includes the sub-steps ofcorrelating a feature of the primary image with a feature of the otherimage; detecting at least one of size, color, and displacementdistortion of at least one of the primary image and the other image;correcting the detected at least one of size, color, and displacementdistortion of the at least one of the primary image and the other image;and assembling the composite image using the corrected distortion. Inyet another implementation, these sub-steps are performed on aper-virtual-unit basis. In yet another implementation, method step 610includes the sub-step of correcting for motion between the primary andthe other image. In yet another implementation, this sub-step isperformed on a per-virtual-lenslet basis.

Referring again to FIGS. 2, 7, 8, and/or, 9 one specific example ofmethod step 610 (FIG. 6) would be logic of image construction unit 212creating a composite image by replacing those virtual lenslet associatedportions of an image captured at a primary position with more in-focusvirtual lenslet associated portions of an image captured by imagecapture unit 206 when photo-detector array 102 was at the otherposition. In one implementation of the example, image construction unit212 corrects for the motion between images using conventional techniquesif such correction is desired. In another implementation of the example,motion correction is not used.

With reference again to FIG. 6, method step 612 shows a determination ofwhether an aggregate change in photo-detector position, relative to theprimary position of method step 602, has exceeded a maximum specifiedchange in photo-detector position. For example, even with a relativelypoor quality lens, there will typically be an upper manufacturing limitbeyond which lens deviations are not expected to go (e.g., the lens hasmanufacturing criteria such that the lens provide a focal length of 5mm+/−0.05 mm).

Referring again to FIGS. 2, 7, 8, and/or 9, one specific example ofmethod step 612 (FIG. 6) would be controller 208 comparing an aggregatemovement in a defined direction against a pre-stored upper limit value.In an implementation of the example illustrated in FIG. 4, if lens 204has manufacturing criteria such as a focal length of 5 mm+/−0.05 mm,controller 208 will determine whether the total forward movement ofphoto-detector array 102 is greater than 0.05 mm relative to the primaryposition. In an implementation of the example illustrated in FIG. 5, iflens 204 has manufacturing criteria such as a focal length of 5mm+/−0.05 mm, controller 208 will determine whether the total rearwardmovement of lens 204 is greater than 0.05 mm relative to the primaryposition. In other implementations, manufacturing criteria in x-yprovide analogous tolerances in x-y distortion which likewise give riseto pre-stored upper limit values in x-y rotation.

With reference again to FIG. 6, if the inquiry of method step 612 yieldsa determination that the aggregate change in position has met orexceeded the maximum specified change in photo-detector position, theprocess proceeds to method step 614. Method step 614 illustrates thatthe current composite image (e.g., of method step 610) is stored and/ordisplayed. One specific example of method step 614 would be imagestore/display unit 214 either storing or displaying the composite image.

Method step 616 shows the end of the process.

Returning to method step 612, shown is that in the event that the upperlimit on maximum specified change in photo-detector position has notbeen met or exceeded, the process proceeds to method step 605 andcontinues as described herein (e.g., moving the photo-detector to yetanother position (method step 605) and capturing yet another image(e.g., method step 606) . . . ).

Referring now to FIGS. 7 and 8, depicted are partial perspective viewsof the system of FIG. 2 wherein photo-detector array 102 is being movedin accordance with aspects of processes shown and described herein(e.g., in relation to FIG. 6). Photo-detector array 102 is illustratedas being rotated through other positions different from the primaryposition which gave rise to the five different portions of image 100shown and described in relation to FIGS. 1–5. The remaining componentsand control aspects of the various parts of FIGS. 7 and 8 (shown andunshown) function as described elsewhere herein.

Referring now to FIG. 9, illustrated is a perspective view of the systemof FIG. 2 wherein photo-detector array 102 is being moved in accordancewith aspects of the processes shown and described herein (e.g., inrelation to FIG. 6). Photo-detector array 102 is illustrated as beingtilted through other positions different from the primary position whichgave rise to the five different portions of image 100 shown anddescribed in relation to FIGS. 1 and 2. The remaining components andcontrol aspects of the various parts of FIG. 9 (shown and unshown)function as described elsewhere herein.

Those having skill in the art will recognize that the state of the arthas progressed to the point where there is little distinction leftbetween hardware and software implementations of aspects of systems; theuse of hardware or software is generally (but not always, in that incertain contexts the choice between hardware and software can becomesignificant) a design choice representing cost vs. efficiency tradeoffs.Those having skill in the art will appreciate that there are variousvehicles by which processes and/or systems described herein can beeffected (e.g., hardware, software, and/or firmware), and that thepreferred vehicle will vary with the context in which the processes aredeployed. For example, if an implementer determines that speed andaccuracy are paramount, the implementer may opt for a hardware and/orfirmware vehicle; alternatively, if flexibility is paramount, theimplementer may opt for a solely software implementation; or, yet againalternatively, the implementer may opt for some combination of hardware,software, and/or firmware. Hence, there are several possible vehicles bywhich the processes described herein may be effected, none of which isinherently superior to the other in that any vehicle to be utilized is achoice dependent upon the context in which the vehicle will be deployedand the specific concerns (e.g., speed, flexibility, or predictability)of the implementer, any of which may vary. Those skilled in the art willrecognize that optical aspects of implementations will requireoptically-oriented hardware, software, and or firmware.

The foregoing detailed description has set forth various embodiments ofthe devices and/or processes via the use of block diagrams, flowcharts,and examples. Insofar as such block diagrams, flowcharts, and examplescontain one or more functions and/or operations, it will be understoodas notorious by those within the art that each function and/or operationwithin such block diagrams, flowcharts, or examples can be implemented,individually and/or collectively, by a wide range of hardware, software,firmware, or virtually any combination thereof. In one embodiment, thepresent invention may be implemented via Application Specific IntegratedCircuits (ASICs), Field Programmable Gate Arrays (FPGAs), or otherintegrated formats. However, those skilled in the art will recognizethat the embodiments disclosed herein, in whole or in part, can beequivalently implemented in standard integrated circuits, as one or morecomputer programs running on one or more computers (e.g., as one or moreprograms running on one or more computer systems), as one or moreprograms running on one or more processors (e.g., as one or moreprograms running on one or more microprocessors), as firmware, or asvirtually any combination thereof, and that designing the circuitryand/or writing the code for the software and or firmware would be wellwithin the skill of one of skill in the art in light of this disclosure.In addition, those skilled in the art will appreciate that themechanisms of the present invention are capable of being distributed asa program product in a variety of forms, and that an illustrativeembodiment of the present invention applies equally regardless of theparticular type of signal bearing media used to actually carry out thedistribution. Examples of a signal bearing media include, but are notlimited to, the following: recordable type media such as floppy disks,hard disk drives, CD ROMs, digital tape, and computer memory; andtransmission type media such as digital and analog communication linksusing TDM or IP based communication links (e.g., packet links).

In a general sense, those skilled in the art will recognize that thevarious embodiments described herein which can be implemented,individually and/or collectively, by various types of electromechanicalsystems having a wide range of electrical components such as hardware,software, firmware, or virtually any combination thereof; and a widerange of components that may impart mechanical force or motion such asrigid bodies, spring or torsional bodies, hydraulics, andelectro-magnetically actuated devices, or virtually any combinationthereof. Consequently, as used herein “electromechanical system”includes, but is not limited to, electrical circuitry operably coupledwith a transducer (e.g., an actuator, a motor, a piezoelectric crystal,etc.), electrical circuitry having at least one discrete electricalcircuit, electrical circuitry having at least one integrated circuit,electrical circuitry having at least one application specific integratedcircuit, electrical circuitry forming a general purpose computing deviceconfigured by a computer program (e.g., a general purpose computerconfigured by a computer program which at least partially carries outprocesses and/or devices described herein, or a microprocessorconfigured by a computer program which at least partially carries outprocesses and/or devices described herein), electrical circuitry forminga memory device (e.g., forms of random access memory), electricalcircuitry forming a communications device (e.g., a modem, communicationsswitch, or optical-electrical equipment), and any non-electrical analogthereto, such as optical or other analogs. Those skilled in the art willalso appreciate that examples of electromechanical systems include butare not limited to a variety of consumer electronics systems, as well asother systems such as motorized transport systems, factory automationsystems, security systems, and communication/computing systems. Thoseskilled in the art will recognize that electromechanical as used hereinis not necessarily limited to a system that has both electrical andmechanical actuation except as context may dictate otherwise.

Those skilled in the art will recognize that it is common within the artto describe devices and/or processes in the fashion set forth herein,and thereafter use standard engineering practices to integrate suchdescribed devices and/or processes into image processing systems. Thatis, at least a portion of the devices and/or processes described hereincan be integrated into an image processing system via a reasonableamount of experimentation. Those having skill in the art will recognizethat a typical image processing system generally includes one or more ofa system unit housing, a video display device, a memory such as volatileand non-volatile memory, processors such as microprocessors and digitalsignal processors, computational entities such as operating systems,drivers, and applications programs, one or more interaction devices,such as a touch pad or screen, control systems including feedback loopsand control motors (e.g., feedback for sensing lens position and/orvelocity; control motors for moving/distorting lenses to give desiredfocuses. A typical image processing system may be implemented utilizingany suitable commercially available components, such as those typicallyfound in digital still systems and/or digital motion systems.

The foregoing described embodiments depict different componentscontained within, or connected with, different other components. It isto be understood that such depicted architectures are merely exemplary,and that in fact many other architectures can be implemented whichachieve the same functionality. In a conceptual sense, any arrangementof components to achieve the same functionality is effectively“associated” such that the desired functionality is achieved. Hence, anytwo components herein combined to achieve a particular functionality canbe seen as “associated with” each other such that the desiredfunctionality is achieved, irrespective of architectures or intermedialcomponents. Likewise, any two components so associated can also beviewed as being “operably connected” or “operably coupled” to each otherto achieve the desired functionality.

While particular embodiments of the present invention have been shownand described, it will be understood by those skilled in the art that,based upon the teachings herein, changes and modifications may be madewithout departing from this invention and its broader aspects and,therefore, the appended claims are to encompass within their scope allsuch changes and modifications as are within the true spirit and scopeof this invention. Furthermore, it is to be understood that theinvention is solely defined by the appended claims. It will beunderstood by those within the art that, in general, terms used herein,and especially in the appended claims (e.g., bodies of the appendedclaims) are generally intended as “open” terms (e.g., the term“including” should be interpreted as “including but not limited to,” theterm “having” should be interpreted as “having at least,” the term“includes” should be interpreted as “includes but is not limited to,”“comprise” and variations thereof, such as, “comprises” and “comprising”are to be construed in an open, inclusive sense, that is as “including,but not limited to,” etc.). It will be further understood by thosewithin the art that if a specific number of an introduced claimrecitation is intended, such an intent will be explicitly recited in theclaim, and in the absence of such recitation no such intent is present.For example, as an aid to understanding, the following appended claimsmay contain usage of the introductory phrases “at least one” and “one ormore” to introduce claim recitations. However, the use of such phrasesshould not be construed to imply that the introduction of a claimrecitation by the indefinite articles “a” or “an” limits any particularclaim containing such introduced claim recitation to inventionscontaining only one such recitation, even when the same claim includesthe introductory phrases “one or more” or “at least one” and indefinitearticles such as “a” or “an” (e.g., “a” and/or “an” should typically beinterpreted to mean “at least one” or “one or more”); the same holdstrue for the use of definite articles used to introduce claimrecitations. In addition, even if a specific number of an introducedclaim recitation is explicitly recited, those skilled in the art willrecognize that such recitation should typically be interpreted to meanat least the recited number (e.g., the bare recitation of “tworecitations,” without other modifiers, typically means at least tworecitations, or two or more recitations).

1. A method comprising: capturing a primary image representation with aphoto-detector array at a primary position; associating a primary set ofdiscrete portions of the primary image representation with one or moredefined virtual lenslets of a lens; moving the photo-detector array toanother position; capturing another image representation with thephoto-detector array at the other position; associating another set ofdiscrete portions of the other image representation with the one or moredefined virtual lenslets of the lens; and assembling an image from thosevirtual lenslet associated portions of the primary and the other imagerepresentation that have relatively sharper focuses.
 2. The method ofclaim 1, wherein said capturing a primary image representation with aphoto-detector array at a primary position further comprises: extractingat least one of a red, blue, or green color component of the primaryimage.
 3. The method of claim 2, wherein said extracting at least one ofa red, blue, or green color component of the primary image furthercomprises: numerically filtering the primary image.
 4. The method ofclaim 1, wherein said associating a primary set of discrete portions ofthe primary image representation with one or more defined virtuallenslets of a lens further comprises: obtaining one or more projectionsof the one or more defined virtual lenslets through a geometric surfacein 3-space corresponding to an imaging surface of the photo-detectorarray at the primary position.
 5. The method of claim 4, wherein saidobtaining one or more projections of the one or more defined virtuallenslets through a geometric surface in 3-space corresponding to animaging surface of the photo-detector array at the primary positionfurther comprises: defining one or more geometric shapes at a predefinedposition of a lens; and calculating a projection of the one or moredefined geometric shapes to the geometric surface in 3-spacecorresponding to an imaging surface of the photo-detector array at theprimary position.
 6. The method of claim 1, wherein said moving thephoto-detector array to another position further comprises: tilting theCCD detector array about a defined axis of tilt.
 7. The method of claim6, wherein said tilting the CCD detector array about a defined axis oftilt further comprises: tilting a portion of the photo-detector arrayforward of the defined axis of tilt.
 8. The method of claim 6, whereinsaid tilting the CCD detector array about a defined axis of tilt furthercomprises: tilting a portion of the photo-detector array rearward of thedefined axis of tilt.
 9. The method of claim 1, wherein said moving thephoto-detector array to another position further comprises: rotating thephoto-detector array about a defined axis of rotation.
 10. The method ofclaim 1, wherein said capturing another image representation with thephoto-detector array at the other position further comprises: extractingat least one of a red, blue, or green color component of the otherimage.
 11. The method of claim 10, wherein said extracting at least oneof a red, blue, or green color component of the other image furthercomprises: numerically filtering the other image.
 12. The method ofclaim 1, wherein said associating another set of discrete portions ofthe other image representation with the one or more defined virtuallenslets of the lens further comprises: obtaining one or moreprojections of the one or more defined virtual lenslets through ageometric surface in 3-space corresponding to an imaging surface of thephoto-detector array at the other position.
 13. The method of claim 12,wherein said obtaining one or more projections of the one or moredefined virtual lenslets through a geometric surface in 3-spacecorresponding to an imaging surface of the photo-detector array at theother position further comprises: defining one or more geometric shapesat a predefined position of a lens; and calculating a projection of theone or more defined geometric shapes to the geometric surface in 3-spacecorresponding to an imaging surface of the photo-detector array at theother position.
 14. The method of claim 1, wherein said assembling animage from those virtual lenslet associated portions of the primary andthe other image representation that have relatively sharper focusesfurther comprises: determining an image score for each of the lensletassociated portions; and storing the image score.
 15. The method ofclaim 14, wherein said determining an image score for each of thelenslet associated portions further comprises: calculating a Fouriertransform of each of the lenslet associated portions.
 16. The method ofclaim 1, wherein said assembling an image from those virtual lensletassociated portions of the primary and the other image representationthat have relatively sharper focuses further comprises: correlating afeature of the primary image with a feature of the other image;detecting at least one of size, color, or displacement distortion of atleast one of the primary image or the other image; correcting thedetected at least one of size, color, or displacement distortion of theat least one of the primary image or the other image; and assembling thecomposite image using the corrected distortion.
 17. The method of claim1, wherein said assembling an image from those virtual lensletassociated portions of the primary and the other image representationthat have relatively sharper focuses further comprises: correlating afeature of a virtual lenslet of the primary image with a feature of avirtual lenslet of the other image; detecting at least one of size,color, or displacement distortion of at least one virtual lenslet of theprimary image and at least one virtual lenslet of the other image;correcting the detected at least one of size, color, or displacementdistortion of the at least one virtual lenslet of the primary image andthe at least one virtual lenslet of the other image; and assembling thecomposite image using the corrected distortion.
 18. A system comprising:means for capturing a primary image representation with a photo-detectorarray at a primary position; means for associating a primary set ofdiscrete portions of the primary image representation with one or moredefined virtual lenslets of a lens; means for moving the photo-detectorarray to another position; means for capturing another imagerepresentation with the photo-detector array at the other position;means for associating another set of discrete portions of the otherimage representation with the one or more defined virtual lenslets ofthe lens; and means for assembling an image from those virtual lensletassociated portions of the primary and the other image representationsthat have relatively sharper focuses.
 19. The system of claim 18,wherein said means for capturing a primary image representation with aphoto-detector array at a primary position further comprises: means forextracting at least one of a red, blue, or green color component of theprimary image.
 20. The system of claim 19, wherein said means forextracting at least one of a red, blue, or green color component of theprimary image further comprises: means for numerically filtering theprimary image.
 21. The system of claim 18, wherein said means forassociating a primary set of discrete portions of the primary imagerepresentation with one or more defined virtual lenslets of a lensfurther comprises: means for obtaining one or more projections of theone or more defined virtual lenslets through a geometric surface in3-space corresponding to an imaging surface of the photo-detector arrayat the primary position.
 22. The system of claim 21, wherein said meansfor obtaining one or more projections of the one or more defined virtuallenslets through a geometric surface in 3-space corresponding to animaging surface of the photo-detector array at the primary positionfurther comprises: means for defining one or more geometric shapes at apredefined position of a lens; and means for calculating a projection ofthe one or more defined geometric shapes to the geometric surface in3-space corresponding to an imaging surface of the photo-detector arrayat the primary position.
 23. The system of claim 18, wherein said meansfor moving the photo-detector array to another position furthercomprises: means for tilting the CCD detector array about a defined axisof tilt.
 24. The system of claim 23, wherein said means for tilting theCCD detector array about a defined axis of tilt further comprises: meansfor tilting a portion of the photo-detector array forward of the definedaxis of tilt.
 25. The system of claim 23, wherein said means for tiltingthe CCD detector array about a defined axis of tilt further comprises:means for tilting a portion of the photo-detector array rearward of thedefined axis of tilt.
 26. The system of claim 18, wherein said means formoving the photo-detector array to another position further comprises:means for rotating the photo-detector array about a defined axis ofrotation.
 27. The system of claim 18, wherein said means for capturinganother image representation with the photo-detector array at the otherposition further comprises: means for extracting at least one of a red,blue, or green color component of the other image.
 28. The system ofclaim 27, wherein said means for extracting at least one of a red, blue,or green color component of the other image further comprises: means fornumerically filtering the other image.
 29. The system of claim 18,wherein said means for associating another set of discrete portions ofthe other image representation with the one or more defined virtuallenslets of the lens further comprises: means for obtaining one or moreprojections of the one or more defined virtual lenslets through ageometric surface in 3-space corresponding to an imaging surface of thephoto-detector array at the other position.
 30. The system of claim 29,wherein said means for obtaining one or more projections of the one ormore defined virtual lenslets through a geometric surface in 3-spacecorresponding to an imaging surface of the photo-detector array at theother position further comprises: means for defining one or moregeometric shapes at a predefined position of a lens; and means forcalculating a projection of the one or more defined geometric shapes tothe geometric surface in 3-space corresponding to an imaging surface ofthe photo-detector array at the other position.
 31. The system of claim18, wherein said means for assembling an image from those virtuallenslet associated portions of the primary and the other imagerepresentations that have relatively sharper focuses further comprises:means for determining an image score for each of the lenslet-associatedportions; and means for storing the image score.
 32. The system of claim31, wherein said means for determining an image score for each of thelenslet-associated portions further comprises: means for calculating aFourier transform of each of the lenslet associated portions.
 33. Thesystem of claim 18, wherein said means for assembling an image fromthose virtual lenslet associated portions of the primary and the otherimage representations that have relatively sharper focuses furthercomprises: means for correlating a feature of the primary image with afeature of the other image; means for detecting at least one of size,color, or displacement distortion of at least one of the primary imageor the other image; means for correcting the detected at least one ofsize, color, or displacement distortion of the at least one of theprimary image or the other image; and means for assembling the compositeimage using the corrected distortion.
 34. The system of claim 18,wherein said means for assembling an image from those virtual lensletassociated portions of the primary and the other image representationsthat have relatively sharper focuses further comprises: means forcorrelating a feature of a virtual lenslet of the primary image with afeature of a virtual lenslet of the other image; means for detecting atleast one of size, color, or displacement distortion of at least onevirtual lenslet of the primary image and at least one virtual lenslet ofthe other image; means for correcting the detected at least one of size,color, or displacement distortion of the at least one virtual lenslet ofthe primary image and the at least one virtual lenslet of the otherimage; and means for assembling the composite image using the correcteddistortion.